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ABSTRACT 


The objective of this thesis is to address the idea of 
implementing a viable T&E technique at the early stages of 
DT&E in order to reduce design discrepancies and mininize 
acquisition costs and time. This technique involves inte- 
gration of Task Analysis, Operator Interviews and Link 
Analysis to evaluate a system's Functional Mock-up. The 
technique will, therefore, be referred to as Integration 
Analysis throughout the paper. In order to provide a measure 
Saree COneribuulon, 2G will be implemented on a recently 
Mececurrecdesvoneml Lhd eCxperienecd numerous HFK design 
Meescrevancies at its OT&h stage. The system in queszuion, 
the Recovery Assist, Securing, and Traversing (RAST) System 
associated with the LAMPS MK III Acquisition, revealed 
mee problems 7m Jpelacion to its LSO Control Station. fhe 
mae Of Shaemoubiecyeseeinigue could have discovered 4 majority 


Samo ose problems much carlier in the Acquisition Frocess, 
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I. INTRODUCTION 


The overall effectiveness of a military system lies in 


Wiaemability of the human to operate, maintain, and support 


the system's equipment. If the human element is not afforded 


the same amount of consideration as. the hardware/software 


cOmponents of the system, the advances achieved in present 


day technology may never be totally realized. This under- 


standing has created a greater concern for Human Factors 


Engineering (HFE) and its potential for improving the end 


product in system design. 


A major catalyst for such concern has been shipboard 


air operations. Air operations include aircraft launch 


ememmecOvery, iMicht control, and close aboard helicopter 


unique tasks such as vertical replenishment. The reasoning 


cope ad et aewGbequirenment for HiE applications in air operations 


is that these operations generally include systems which: 


ils 


ree eehty complex and sophisticated and, therefore, 

fea cult FO Onperate and maintain 

Require a high degree of interaction and coordination 
among Operators 

Reauire extensive human judgement and decision making 
Comprise operations which are critical to the safety 

Cf aircrew and ship’s personnel 

Include sequences of operations which are highly 


meme Consurained and time critical. { Ref. 1} 








such considerations have increased efforts to apply HF 


technology during the Systems Acquisition Process. The 


development of a HF Test and Evaluation Program has helped 


to structure these efforts and produce more efficient systems. 


MIL-H-46855B (Human Engineering Requirements for Military 


Systems, Equipment and Facilities) requires that a T&E Program 


Bepamcerrated into engineering design tests, contractor 


demonstrations, and Research and Development acceptance tests. 


Generally, the purposes of such a program are: 


lic 


2S 


V1 


To assure fulfillment of applicable requirements 

To demonstrate conformance of system, equipment and 
facility design to human engineering design criteria 
To confirm compliance with performance requirements 
where man is a major system performance determinant 
le secure quantitative measures of system performance 
which are a function of man-machine interactions 

To determine whether undesirable design or procedural 


features have been introduced. {Ref. 2} 


The implementation of the HF Test and fvaluation concept 


meow pie Naval System Acquisition Cycle has, therefore, 


afforded the opportunity to validate system design throughout 


the entire Cycle. 


The separation of the Cycle into a number of stages, 


Miciwcmme comecptual, validation, full scale development, and 


production/deployment lends itself to a series of check 


bomm@oc during the system's acquisition process. At the 





conclusion of each stage, the Defense System Acquisition Review 
Council (DSARC) assesses the achievement of the appropriate 
milestones. Hach succesive Review demands more stringent 
BUaReards in relation to HFE design, thus, increasing the 
requirements for Test and Evaluation. { Ref. 4} 

imi Order LO adequately cover the differentystages of the 
Acquisition Cycle, T&H has been separated into two Ae os: 
Development Test and Evaluation (DT&E) and Operational Test 
and Evaluation (OT&E). The process over the stages of the 
Mequisition Cycle is depicted in Figure 1. DT&z emphasizes 
the technological and engineering aspects of the system and 
memretrtally carried out under controlled conditions. OT&E 
mie bUdes all efforts in relation to obtaining operational 
information from prototype development through the system's 
Hefe cycle. As a result, the T&#E process follows the system 
meonmrice cempletion of DSARG Lf and contintes throughout its 
ie tkef. 3 } 

Preece UIeh the deyeloping agency is responsible for 
weaimerine Lests to verify system performance and solve 
technical problems. Basically, it must establish that the 
system meets performance requirements and objectives. It 
must, aiso, be operable, reliable, supportable, maintainable 
and have acceptable engineering. {Ref. 2 } 

rooreno DoAnRG Liv iGee is concerned @watn identifying 
emuoreal Questions, issues, and possible deficiencies. After 


DSARC JI it concentrates on identifying deficiencies and 


addressing any questions in order to achieve a system which is 


10 
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wey tor production. Aiter DSARC III, DT&E is relegated to 
validating the fact that deficiencies identified in OT&E have 
deen corrected. | 

OT&s is divided into two types: Initial and Follow-on. 
Doral Cle is accomplished prior to production (DSARC III). 
Mmeeses intormation from DT&# testing and conducts its tests 
using orototypes Omepa lot meduction systems to determine 
operational effectiveness and suitability. Follow-on OT&# is 
SCemaiicteca aiter the production decision and by fleet operational 
perscnnel. 

In addition to the usage of controlled conditions for 
DTG versus operational conditions for OT&#, there are other 
dimensicns that make them different. Both DT&# and OTél 
@emetoe GO 1dentify HF& discrepancies during their respective 
processes, however DT&HE is initiated earlier in the Cycle 
meee tiereitore, may affect the number of deficiencies detected 
pe OG 

pach system has various representations that are evaluated 
ads the acquisition process proceeds, such as: 

1. An analytic concept 

2. Design drawings 

3 Non-functional mockups 

4. Functional mockups 

De Pecduiet One LP roLtotypes 

See LOL Production items 

eit) Production acems 
While DT& is applicable to any representation of a systen, 
Mea apolies to only the last three. { Ref. 2} 

de 





Another aifference is in terms of the operators. DT&E 
data are usually obtained:by the evaluators or by test subjects 
selected to represent the actual users. OT&E uses personnel 
meee will be eventual operators in the fleet. 

Earlier initialization and a greater variety of system 
representation suggest that DT&H lends itself to a broader 
Seoge Of (et techniques during the Acquisition Process. 
hach additicnal system representation offers an additional 
Opportunity to evaluate various aspects of the system by 
utilization cf various techniques. The number of different 
techniques utilized is directly related to the expediency at 
Which DT&i is organized and implemented into the Cycle. Once 
into the Gyele, the wide range of T&E approaches used in DT&E 
PeOviC2s ag Opportunity to discover discrepancies early on, 
and therefore, enables a smoother OT&& process once it enters 
maco the Cycive. 

ine wapopawea tagon Of a particular T&h technique in DT«&s 
depends on the phase of the Acquisition Process involved. 
Pacw sr oease requires the completion of certain milestones, or 
Cbjectives, before the next Phase can be started, as depicted 
met oro ie forma! introduction of DI&# occurs after 
PerncC 1. {aet. 4 } 

As the process continues, the system matures as do the 
T&R and DSARC requirements. it is important to realize that 
even though a system completes a milestone, the elements 


miwolvyeqc in chat achievement are not considered finalized. 
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Ll. Approvei ot MENS 


A. Requflrements Piase 
-~ Is a new system needed? 
~ What dovs {2 need tuo do? 
~ Identities Operational Conditions 
-~ Ideecifies Environmental Conditions 
- Analyzes Similar Systems 
- Milestorr 0 


B. Conceptual Pnise 
- Seleeciun of alternatives 
~- Can the requirements be met? 
- Requivemencs Analysis 
~- Fuacrion Allocation 
-~ Minnins Analysis 
Position Descriptions 
- Task Analysis/Simulations 
-~DSARC {f- Milestone I 


C. Validation (Demonstration) Phase 
- Workspace Layout in response to communication, control, display 
and man-computer/machine requirements 
- Maincenance- Roles & Responsibilities 
- Job Performance Aids 
- Training - Sxill/knowledge Requirements 
- Media 
~ Personnel 
- WSARC il= MLllestone II 


D. Full Scale Development Phase 
~- Contractuaj Kequirements 
- Mockups 
~- Svstem Simulations 
= "Prototype EVal: BISE/WIGE 
-~ Criticas Sesign Reviews 
~ Pilot fest of Training Program 
- Maintenance Procedures 
- Operational Procedures 
- DSARC IIt- Milestone IIL] 


E. Production/Vepjloyment Phase 
- Modifications 
- Safety 


Figure 2. HFE & System Acquistion Cycle 
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AS the System develops, operational procedures, new technology, 
or newly discovered design discrepancies may force engineering 
changes cr re-evaluation of the analyses conducted in the 
Conceptual Phase. This causes a hold up in the Process until 
the system is re-evaluated using the modified version. Such 

a looving effect results in time delays and cost overruns. 
Granted, new technology and changes in tactical doctrine 

should be implementea if feasible, but redesigns, especially 
well into the Cycle, can and should be minimizeca. Therefore, 
the early introduction of T&m into the Cycle is imperative. 

The completion of the system's Task Analysis provides an 
ror oumi oy fOr anitiation of techniques to identify HF design 
deficiencies. The Task Analysis is quite adaptable to the 
various testing apprcaches available to DT&E. In combination 
With system “ock-ucs or models, adequate operational scenerios 
can be develored and evaluated with respect to HFE design. 

Such evaluations can be repeated inexpensively throughout 
miemeecgutsition cycle to analyze changes in Operational 
procedures or new technology. Most importantly, the early 
Mepeacance of DTt® tn the Acquisition Cycle provides an advanced 
Peeertinity LO aiscover design discrepancies on a maturing 

yet viable system. 

lie ObVective Of this thesis 2s to address the idea of 
implementing a viable T&® technique at the early stages of 
DT&E in order to reduce design discrepancies and minimize 


MedurombiO0n COsts and time. This technique involves integration 


i 





of Task Analysis, Gperator Interviews and Link Analysis to 


evaluate a system's Functional Mock-up. The technique will, 


a) 


therefore, b 


o 


referred to as Integration Analysis throughout 
the paper. in order tc provice a measure of its contribution, 
it will be implemented cn a recently procurred system that 
experienced numerous dF design discrepancies at its OT&# 
stage. The system in question, the Recovery Assist, Securing, 
and Traversing (RAST) System essociated with the LAMPS MK III 
Acquisition, revealed HFE problems in relation to its LS0O 
Control Station. The use of the subject technique could have 


discovered a majority of those problems much earlier in the 


AGQUISition Process. 
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If. CENERAL APPROACH 


A. FORMAL INTEGRATION 

The formal integration of DT&HE into the System Acquisition 
Process implies an advanced version of the Task Analysis for 
Be subject system. In order to set HFE T&E off to an expedi- 
tious and comprehensive start, the availability of the Task 
Analysis offers an immediate evaluetion technique. 

The detailed steps of the Task Analysis makes it possible 
to conduct a Link Analysis of the system's various operational 
Scenerios. tWhe information odtained from the Link Analysis 
May point out dfn design problems encountered during the 
course of the system's task sequence. The Task Analysis can 
also be used to create the system's operation on a Functional 
Mock-up. Any problems experierced by the Mock-up's operators 
during the performance of their tasks may reveal HFE discrep- 
ancies. When the resuits of the Link Analysis and the Operator 
Interviews are combined for comparison and verification, the 


HF T&E process will have been given an early, relatively 


inexpensive, and substantial boost. 


B. GHNERAL APPROACH 

Meemcederal approgen Lo thas evaluation procedure ineludes 
the following steps; 

1. Participation in the development of the Task Analysis 


to ensure adequate details are included for use in T&t. 


Aes 








2. Incorporate the Task Analysis into the development 
and operation of a Functional Mock-up. 

3. Perform a Link Analysis by following each operational 
SCcCuctPhO melee lack Anal yous. 

mo ivatiapewam@esbink Analysis results with respect to 
suboptimal HFE. 

5. Interview the operators of the Mock-up with a well 
structured procedure for extracting both obvious and 
underlying HFE problems. 

6. Compare the Link Analysis with the Interviews to 
Eomrelave a1ccOverca Gi Scrspancies. 

A Task Analysis is a study tnat develops a sequence of 
tasks necessary to accomplish each function allocated to man 
fRerf. 5}. It determines information and control requirements, 
skill and knowledge requirements, cossible errors associated 
with each task and their implications, workloads, and scheduling 
foommltaneous or individual task execution) {Ref. 6}. The 
Sowuayor cs involvement in the comoletion of the Task Analysis 
Ssures that these necessary details are included, and 
~Twerribelently GOvereac. A simple sequential listing of the tasks 
Mees ue Crovide tic necessary, information to ascertain if a 
Pow iecUlbar task can be performed adequately, if at all. 

With a comprehensive Task Analysis in hand, the operation 
of the system on a Functional Mock-up can be conducted in 
(oar omrcou wor ceadecUatrely realistic conditions. The controlled 


Pav eeem@mcduecdeciulalily atrords, the operators a greater opportunity 


is 





to fully judge if each task can de compieted according to the 
information and control requirements stipulated by the Task 
maa lysis. 

Link Analysis is a technique which »vrovides information 
needed to produce an acceptable arrangement of men and machines 
in a system {Ref. 6} . Before a link analysis can be performed, 
firm decisions must be made about the sxact items of equipment 
to be used, the number of men who will operate them, and the 
functions that will be performed {Ref. 5}. The rationale 
behind the link analysis techniques is that the "best arrangement" 
can be found only by optimizing different types of links that 
are important in the particular systen being designed. A 
link is a connection between (a) an operator and a machine or 
(b) two operators. The links may be visual (such as an 
instrument scan), functional (hand to control), or verbal. 
irentfaicieneres oecur when links are comparatively long, crossing 
pmewanother, bloeked, or outside optimal visual or reach 
envelopes. The links produced from the Task Analysis illustrate 
meiecone Operator required functional, visual, and communication 
Poems. the lank Analysis canebe applied to all scenerios 
involved during all operational and emergency conditions. 
cme sande} . 

Since the Link Analysis depicts every requirement and the 
possible restrictions in their attainment, the Link Analysis 
may reveal problems that could be unconsciously compensated 


for by the operator during the Mock-up operation. By conducting 


0, 





the Link Analysis evaluation before the Onerator Interviews, 
these compensation areas could be addressed in the interview 
in order to access their degree of importance. 

The Operator Interviews are sectioned irto wo types of 
questions: general and specific. The interview begins with 
general questions to determine whether any performance problems 
have been noted by the operator. More specific questions 
follow to cover the range of equipment/job variables that 
could influence performance Stren as: 

1. Equipment characteristics 


‘ environment 


See aids 


Z 
3 
4. safety 
5. manning 
oa training 
fo LatTorma tion 
on communications 
It is assumed that if the System test consists of several 


5 


Operations or cycles, the operator will be interviewed following 
each such operation cycle. {Ref. 7} 

The final step in this integrated HFE evaluation technique 
involves the compilation of all the information obtained through 
Peewlank analysis and the interviews. This comparison step can 
help verify discrepancies and provide a means for selecting 


@S8mrection priorities for each discrepancy. Further, it may 


be possible to discover other problems when the two techniques 
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are combined and analyzed. What appsars to be satisfactory 
Pmaluauihons Lor oie individual techniques, may reveal underlying 


problems when all the information is integrated. 


C. PRACTICAL APPLICATION 

Pebwucrhcoleaoplication of this formal integration of Task 
Analysis, Link Analysis, and Operator Interviews on a Functional 
Mock-up was implemented on the RAST System. It concentrated 
on the System's primary operating area, the Landing Safety 
Officer (LSO) Control Station. Even though the System is near 
iPomcomolbetlOm in the Acquisition Process, the comparison of 
this technique's contribution to HFE T&E when applied during 
the System's early development and the actual multiple HFE 
discrepancies discovered during the System's advanced stages 
give a direct measure of its worth in relation to redesign 


costs and Acquisition Process time delays. 


D. RAST SYSTEM DESCRIPTION 

The RAST System was developed in an attempt to increase 
Safety during helicopter launch, recovery, and deck traversing 
on single landing area air-capable ships such as Frigates and 
Destroyers. it 1s being implemented on the Oliver d. Perry 
lass Frigates (FFG-7) and the Spruance Class Destroyers 
(DD 963). In conjunction with the LAMPS MK III development, 
one system was installed on the USS McInery (FFG-8) for System 
Acquisition evaluation. {Ref. 8} 

The RAST System is designed to support the landing, 


Bovweneme , and Handling of helicopters during sea conditions 


ca 





of up to sea state five. The System has four major operational 
segments: 

1. Traversing the Helo across the flight deck (in or out 

of hanger) 

2. baumen 

a. Recovery 

4. Maneuvering and Straightening the Helo for sulignment 

With the track 
wormierol Off taewanol System is¥accomplisned oy the bse ioccated 
at a control console within a rigidly constructed enclosure 
that protrudes above the flight deck as depicted in figure 3. 
ieee sseresponsi bility for visual inspections of the wmeli- 
COmmersauring Operations necessitates the station's cloé¢e 
proximity to the landing-launch area. {Ref. 8} 

A typical operating cycle of the RAST system includes: 
traversing the helicopter along a track from the hanger aft 
to the launch area; helicopter launch; hook-up of the heli- 
copter with the hauldown cable; hauldown and securing or the 
helicopter; alignment of the helicopter with the track; ana 
meaversing the helo forward santo the hanger. ihe £50 must 
Demetri ved with the conumolcssaisplaoys, and communications 
equipment necessary for the sare and efficient conduct of 
ie, Operauon's jeycre. 

In detail, the Recovery Assist Mission is as follows; 

As the helicopter approaches, a messenger cable is deployed 


from the helicopter to the flight deck below. The RAST 
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cable is attached to the messenger cable and winched uo by the 
aircraft. After the cable end fitting is locked into the 
aircraft's main probe, the pilot selects the apvronriate power 


" 


meee LO Maintain hover over the ship's flight deck. The 


Stee. bensioned with 4,000 pounds pull, is controlled by the 
LSQO who operates the RAST console on deck. The LSO waits for 
meeeourh in the swells Signals the pilot, and through their 
quick and coordinated action, the tensioned cable assists the 
helicopter to land safely. The main probe engages an arresting 
device, called the Rapid Securing Device (RSD), which secvres 
bme helicopter probe to the deck. The pilot then sruts the 
mereratt down. {Ref. 9 } 

The basic plan for the system presently instalied on the 
USS McInery used the Canadian Beartrap configuration 433 ar 
initial guideline. The placement and configuration for eéch 
RAST subsystem was determined with the help of land césed 
Geee-ups of the ship's flight deck and RAST contrel rooms. 
The prototype was then installed on the McInery for é&t-sea. 
eecruat? Ons in conjunction with the LAMPS MK III progam. 
During the LAMPS MK III TECHEVAL in 1981, the LSO's Control 
piaaen revealed a substantial amount of HFE deficiencies 
{Ref. 8 and 10}. Some of the general problems encountered 
iaelude : 

m—ercctricyed fields of vision. 

2. Controls, displays, and communication equipment not 

optimally placed. 
3. Inadequate exterior and interior lighting. 


4. Complex control manipulation. 


ah, 





Mimereune adt=—cea [ECHoAVAL {Ref. 6}, &@ review of the LB® 
otation was conducted at a mock-up with the Naval Architects 
SreGitobs and Cox, inc. {Ref. 10}. The participants of the 
TECHEVAL recommended design changes and modifications to the 
aioe d) in Order to eorrect identified design deficiencies 
or enhance its operational suitability and human factors 
characteristics. 

The changes resulting from the mock-up review {Ref. 10} 
and the discrepancies reported in the NATC Technical fevort 
Gi=J20h= Si {Ref. 8} greatly improved the HFE of the staticn, 
Vemibecet tt) held Up the Acquisition Process. A listingmaf 
the TECHEVAL and Mock-uv review discrepancies and changes 
is contained in Appendix A. 

The demonstrative application of the proposed Integration 
Analysis will focus solely on the LSO Station instatled an 
tae Uss Meinery and will be directly applicable only tc 
Mog, class ships. The location of the station on othez 
Slaee ships, such as the DD 963's, will be different and 
therefore nave unique perspectives and constraints requiring 
Beecebarape,, but procedurally equivalent analysis. It snould 
be realized that an attractive characteristic of Integration 
Analysis is that its general methodology is an applicable 


evaluation technique for any complex man-machine system. 
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Tift. DeVeLOPING A SUITABLE TASK ANALYSIS 


A. DeVELOPMENT 

iiestbi lity Om integration Andlysis to detect HFE diserepancies 
has a great dependance on the comprehensiveness of the Task 
Analysis. An inadequate attention to detail may miss some of 
the information required by an operator, exclude short but 
important tasks, and/or fail to reveal the complexities of a 
Seecitic task. 

A useful Task Analysis for this type of HFs T&h tecnnique 
must consider the information, control, and performance 
Pequiaremenhs Lor all operational and environmental conditions. 
ft must, also, address performance error impact, worklcads, 
and scheduling effects for these conditions {Ref. 6} . 

In order to produce an adequate Task Analysis, the sters 
that involve the gathering and organizing of the information 
needed to develop it must be completed and understood. These 
Steos include: 

1. Review Operational and Technical Documentation 

2. Assess System/Mission Requirements 

3. Identify applicable operational and environmental 

eondi tions 

4. Funetional Analysis 

5. Requirements Analysis 
6. Function Allocation 
i 


Work Station Design 





- 


These steps flow in a sequence (figure 4) that eventusily 
accumulates and integrates all the information needed to 

develop a comprehensive flow of the sequential tess of a 

system {Ref. 1 and 2}. 

To begin, a study of the System's operation and maintenance 
manuals and interviews with system designers gives one an 
Emerer Standing Of the capabilities and constraints of the system, 
By simply knowing the basic operation of the controis and 
displays, the analyst will better appreciate the complexities 
of the systen. 

Once the System/Mission requirements are known, all the 
operational and environmental conditions that could be 
encountered in meeting those requirements can be identified. 

Mice ler process must be aware of all possible conditions, 
otherwise analysis of the system may not have an opportunity 
memevalittate the system's full spectrum of usage. Such 
incomplete analysis may delay discrepancy detections until 
moma ysuem 1S Used in actual operations by the Fleet. 

iene Gaongs Analystseelists the = tumevrons to be carried 
out to complete each Mission requirement. The analysts initial 
research of the operation and maintenance manuals affords a 
Peemunderstanding Of each function and 1ts associated 
eeomolexi tiles. 

The Requirements Analysis determines the information and 
Performance requirements for each function under each operational 
amcwenvironmental condition { Ref. 5}. To be complete, it 


should include emergency procedures/conditions. 
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Once the integration of the functions and their associzted 
information and procedure requirements is complete, the 
allocation of certain functions to either man or machine can 
be conducted. This in turn leads to a workspace design and 


an opportunity to evaluate that design using the Task Analysis. 


B. PRACTICAL APPLICATION 

Research into the LSO Console Station's development failed 
to produce a Task Analysis suitable for an application of 
Integration Analysis. The best report located was a Task 
Listing made for an LSO Training Program{ Ref. 9}. It covered 
all operational scenerios and their respective emergency 
procedures, but fell far short of adequately addressing 
Civmmenmenval conditions, error impact, and information 
he@ueee memos tOr decision making. 

By following the steps of the Task Analysis Development 
Sequence (Figure 4), a comprehensive Task Analysis was produced. 
The sequence was used as a eos to be sure that all the 
Meceeeeary ineredients of an adequate Task Analysis were present. 

Seem elec awas Obyiously necessary to fully understanc 
Diewogemeehomeot tne LoO Suatiom before any analysis c@ula Ge 
SComeaucted. Control of the RAST System 1s primarily conducted 
at the LSO's control console (Figure 5). Through research of 
the Console's Operation and Maintenance Manual (AD-700A0-OMI-010) 
{Ref. 11}, review of the ship's Helo Flight Operations Bill 
ieme12), studying of the LSO Training Syllabus Ref. 13 , and 


repetitive question sessions with project managers, most 
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control and display idiosyncrasies were identified. Then the 
Pierunonsot cach control and display in the Station, but not 
on the console, was determined and their operation understood 
(Figure 6). 

Steps 2 and 3; Recall that the RAST System has four major 
Operational segments: 

1. Traversing 

2. Launch 

Demeete covery Missist 

4. Maneuvering and Straightening 
The LAMPS MK III Mission is expected to be conducted in most 
Weather conditions (Sea State 5 or below) {Ref. 8}. Therefore, 
whe RAST needs to be evaluated for each of these conditions: 

1. Day or Night 

mae Lropical or Artic temperatures 

3 Rain or Snow 

AeeeMeaximum ship Pitch and, Roll 

pemeootpboard Fire 

oe Aircraft Crash 

The results of the Functional Analysis were basically 
represented in both the Task Listing and the LSO Training 
piper ous. Therefore, the necessary inputs to the Requirements 
Analysis, steps 3 and 4, were available. 

With the review of the Task Analysis Development accomplished 
POmtuaiao Polit, the information was organized and integrated into 


a Task Analysis suitable for Integration Analysis. 
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Figure 6 
LSO Station Layout on the FFG-8 


(Obtained from Redesign Agency, 
GIBBS&COX INC., NEW YORK, N.Y.) 
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Pee eee nGCOVERY ASSIST TASK ANALYSIS 

PimoGcder “TovSscale whis practieal example down, only the 
Recovery Assist segment of the RAST's operation will be 
eeeeaaned in detail with respect to Integration Analysis. 
The Recovery operation entails the most safety related and 
Semoplex tasks. The overall results of the analysis will be 
meeoettved in the conclusions. 

The Task Analysis for the Mission of Recovery Assist 
(Appendix 8), was constructed using the LSO's Task Listing 
{Ref. 9} as a guideline. By enriching the contents of the 
[ioe fisting with the information accumulated from the research 
conducted on the System, the resulting Task Analysis addressed 
famealeareas of concern for Integration Analysis and, in general, 
HFE T&E. It should be noted that the Task Listing was also 
produced using the development sequence discussed earlier in 
mieoechapLrer, however it didn't go into sufficient detail for 
Our purposes. 

Bach task was separated into subtasks and each subtask 
was analyzed with respect to: 

1. Performance Actions 


2. Knowledge/Information required to carry out the 


subtask 

Beeeeihe Control(s) involved in the subtask 

4.) The Display(s) involved in the subtask 

5. Possible Constraints/Malfunctions that may hinder the 
conduction of the subtask 

6. The impact of an error performed during the subtask 


SNe, 





The actions performed during a subtask are basically the 
meowlt Of the functional analysis and function allocation. 

A working knowledge of the system is necessary to fully 
appreciate this section. 

The Knowledge/Information required to carry out each 
subtask is obtained through the requirements analysis. It 
1s imperative that this section be as complete as possible. 
The results of this section affords the basis of the Possible 
Constraints encountered section. If an Information requirement 
is missed, certain constraints may be overlooked and may 
Peestbly result in an unnoticed HPs discrepancy. 

Micerecsible Gonstraints section deals in both specific 
and general terms. It is designed to draw attention to 
various areas of interest for each subtask. For example, 
meeuae Obstruction can include restricted fields of vision 
Mes ooestructural design, glare, direct sun, rain, snow, fog, 
Cr perspective. Indicator [illumination describes inadequate 
mmminedatlon of a display due to glare, inadequate lighting, 
Or electrical problems. Specifics attempt to draw attention 
to control operation, displays (or lack of them), and 
coordinated maneuvers that may cverload the operator. 

Error Impact is used to give the analyst an idea of the 
severity of a constraint or the lack of information necessary 


to complete a task. 
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IV. LINK ANALYSIS 


A, FRAMES OF REFERENCE 

Once a comprehensive Task Analysis has been developed, 
tne next step in the general approach to Integration Analysis 
i$ the concurrent application of the Task Analysis to the 
operation of the system's Functional Mock-up and the perfor- 
mance of a Link Analysis. The design of the Functional 
Hock-up is a result of research that uses the task analysis 
memeevelop the crew station configuration. A practical 
Peplication of the Task Analysis to the Mock-up is, therefore, 
evaluating that design and, for Integration Analysis purposes, 
PeeParine the subjects for the operator interviews. The Link 
snmalysis is helping to create pertinent questions to be asked 
=n those interviews. 

The analyst's approach to the development of the Link 
Analysis depends on the system's general mode of operation. 
Miewimyrormation generated or used throughout the system's 
operation is acquired in either a) two dimensional or b) 
mhree dimensional frames of reference. Two dimensional 
examples include a Radar Console panel in the Combat Information 
GCemter (CIC) on a Ship or 4n operations floor plan where 
various operating stations are positioned throughout a room 
bOwOrovide expeditious interactions, such as CIC. All the 


information associated with the Radar Console can be depicted 


2p 





Dy one diagram of the panel and all the interactions of the 
operators can be illustrated by an overhead view of the room's 
floor plan. A three dimensional mode of operation involves 


=) 


meme vse OF; links from sources external to the system's control 
Beaoer. AS With the RAST's Recovery Assist mission, information 
vital to the system's operation involves visual and communications 
links external to the station. The two dimensional depiction 

of the console panel is insufficient to adequately cover the 
operation's various information links. Various scales and 

Pramss Of reference need to be used in such a cost to clearly 
dispiay each link during the system's operation. Clarity and 
Simplicity is vital if the benefits of link analysis are to 


bee rcalizged. 


Pe FrAClT{CAL APPLICATION 

Tae Recovery Assist link analysis began with the identifica- 
meemeot une external visual links of the operation. Figure 7 
Seeas the location and lines of sight for each visual link 
involved in the complete mission. 

By starting out with an expanded external view the analyst 


is given the "big picture" in relation to the system's operation. 


aa | 


his view also shows that the operation entails visual links 
that require more than a single plane of reference. fhe 
Hover/Centering and the Approach links indicate that informa- 
Mometcaduisitton is going to require extensive fields of 


view. 
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Inspection of this most general link diagram produces the 
following opservations: 


1. A narrow field of view exists with respect to a 





hovering helo over the RSD's. Lateral positioning 
of the hel» could prove difficult due to the operator's 
acuiLe perspective. 

é. Starbdcard side clearance for approach will be impossible 

due to the lack of a rear window at the station. 

By telescoping down to a more detailed representation of 
the LSQ Station, the visual links can be better scrutinized. 

| Figure 8 deals with the same visual links as in Figure 7, but 
the links are analyzed on a smaller scale. This results in 
ieee iks indicating possible structural obstructions. The 
PmiobremcuLons “due to tke lack of a rear window are illustrated 
fememcaratatically at this scale. Further, the severity 
tee oomen. Of the various window fram restrictions is excellent 
material for the operator interviews. 

The next step in the scaling down process involves analysis 
of the sysvem's central control panel, the LSO console panel. 
eince the external links have been addressed, the link analysis 
can be conducted on a two dimensional frame of reference as 
Peeaeped by bhe Console diagrams in this chapter's appendix. 
ipecomeeoneacn focuses the analyst's attention on the arrange- 
fememor tae displays and controls used durinp the Recovery 
Mmooweumtssion., Relative directions of the lines of sight 


Soarernal to the station are sufficient for this scale of 
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analysis, but internal visual links need to be illustrated 
as accurately as the manual links in order to judge optimal 
Gisplay-control arrangements. 

The links are nunbered to coincide with the tasks and 
subtasks of the Task Analysis (Appendix C). Each subtask 
contains their own combination of manual and visual interactions, 
thus they may result in strictly manual links, strictly visual 
links, or a sequential combination of manual and visual links. 
femiavernal yisual tjnks directed to the right of the console 
refer to lines of sight to the wind speed/direction, pitch, 
roll, and ship heading indicators (see Figure 6 for exact 
locations and arrangement), 

The links are anaiyzed for the following discrepancies: 

[ee inks e€rossiaqe Within @ task indicating inadequate 

amar cemen ts. 

2. Sequences of links that cause a large manual and/or 
visual envelove for a task. In this case, if the 
manual links for a particular hand and their associated 
visual links are not in a narrow envelope, the controls 
and displays for that task are not close enough or 
in line with each other. 

Peeebenks that indicate excessive Operator workloads. 

This may result during coordinated maneuvers that 
involve multiple subtasks at a certain control in a 
Shomuepertod Of Gime. ~Performance errors become 


common place in Such a Situation. 
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feeeuonme manual or jmternal visual links. 


>. Links that go outside optimal visual or reach envelopes. 


Primary displays should have envelopes of 15 degrees from 


elther side of the line of sight, 35 degrees for 
secondary. Gontroi envelopes depend on workstation 
design, but are in many respects similar to display 


envelopes. { Ref. 5} 


Meee st Major dicernepaney occurs at task 3-4 where, once 


again, the visual ciearance for approach is blocked by the lack 


of a starboard window. The external visual check of the 
deck status lights (3-4-2) is not a vital link at this stage 
Pee Mission so its displacenent from the primary visual 
envelove is not a major concern. 

Mimeuacke 3-6 the pace of the mission picks up. Its links 
Show an excellent narrow envelope, indicitive of proper dis- 
play and control arrangement. But, a burdensome situation 
appears at the right hand control lever. Simultaneous ten- 
sion control and communication tasks could cause performance 
Pmcors. in additicn, multiple checks of the Internal indica- 
tors are removing the operator's attention from the primary 
visual envelope. The emergency task (3-68) appears to have 
wepacequave link arrangement if the deck status light check 
Memseut)l considered non-vital. 

The links in task 3-7 illustrate the same discrepancies 
as in task 3-6. The emergency wave-off task, though, shows 


wadceetne Operator could be faced with a degraded performance 
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mimacion. Clearance restrict#ons, simultaneous tension 
eemvrol and communication tasks, and displaced internal in- 
dicator checks could all causes an overloading situation for 
the Operator. 

At task 3-8 the pace has slowed down a little and visual 
envelopes can be widened, which allows the external visual 
imeeeo the tail sprobe (3-8-6) to be acceptable. The rest 


Sieone links in this task apoear satisfactory. 


G. APPLICATION OF RESULT 

The various discrepancies noted in each of the three frames 
Seercacrence may be used as materiaa for immediate T&& dis- 
crepancy reporting or as material for the development of the 
Mmeeweapor interviews. With respect so the interviews, the 
Mmiem@emeanalysis discrepancies contribute specific questions to 
go along with the questions aadressing the range of variables 
mentioned in chapter Ii for the particular system being evaluated. 
In the Recovery Assist analysis, discrepancies dealing with 
mMebepective, frame restrictions, and operator workloads may 
be unconsciously overlooked by an operator during his Func- 
tional Mock-up tests and subsequently in his interviews. 
Specific questions in relation to these problems would make 


the operator aware of them and as a result provide a measure 


of each problem's severity. 
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Ve. OPERATOR INTERVIEW 





A. QUESTIONNAIRE DEVELOPMENT 

The 1978 Navy Personnel Research and Development Center 
publication, "Human Factors in Operational System Testing: 
peManual of Procedures" {Ref. 7; was the exclusive guide in 
the development of the questionnaire (Appendix D). It pro- 
meee on une general approach and many. of she specific questions 
Memcitouire adequate coverage or tke HMock-up's HFE concerns. 

The planning of its contents snd tha eventual results of 
iiemiboerview nad tS avoid a major Diasing factor for this 
Bear eecular practical and illustrative avplication of Inte- 
gration meee sisy 411 Of Sone Gperauors intervaewed nad 
eieitm@ea their LsO Console Station sxperience during either 
bone OPEVAL or TECHZVAL tests of the RAST. Therefore, many 
of their responses and ooservations wou.d be much more ex- 
tensive than if they had only workad with a Functional Mock- 
teeta ts forced the interviewer to avoid questions pertaining 
momenvarorments or situations now possible with a mock-up 
and to disregard answers that went beyond the scope of a 
mock-up's capabilities. 

The questionnaire development also faced an excessive 
pumeedebay from last operation to actual interview. Not 
Sabyevas 1t impossible to interview each operator after the 
Somotetwon Of each individual mission, the interviewer also haa 
to accept. intervals up to 6 months between operation and 


PiberyLew. 
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In retrospect, the time delay problem offers a supportive 
magument tor increased use of Mock-up interviews. Such 
Hiwervyiews can be easily conducted after each operation, 
minimizing the possibility of inccemplets appraisals that are 


probable with time delays. 


Be. QUESTIONNAIRE CONSTRUCTION 

The problems of at-sea operation bias ani time delays 
necessitated a preliminary operator information section to 
enable the interviewer to assess the onerator's experience 
(see Appendix D). In the preferred situation of conducting 
meeerviews after each Mock-up operation, information such as 
feweter, time Of day, pnysical characteristics of the operator, 
and experience in that mission would be applicable. 

The interview begins with ail encompasing General ques- 
Grons tO allow the respondent to focus on the most important 
difficulties he experienced. Keep in mind, each interview 
should be conducted after each mission. All four RAST 
missions are addressed at once due to the circumstances 
mentioned in Questionnaire Development. 

The General questions should make the respondent consider 
outstanding difficulties, personnel coordination (if applicable), 
task procedures, complexities, fatigue, training, equipment 
relability, and equipment availability and usage {Ref. 7}. 

Such questions allow the respondent to select what he considers 
Piememocteamportant topijes. They also help him to, reflect on 


deetaculties that may arise for less skilled operators and, 
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mivichmaoceas procedures and compiexities of various tasks. 
iaesGeneral equipment questions may cause the orerator to 
Gece Unnecessary, missing, cr unreliable ecuipment. 

Pipes Socitmeemaquestions follow the Generel questions, but 
if a General question generates a response to a Specific 
eca,) une Bnibervaewereshould Logically proceed to that area. 
Inflexible interviews may cause incomplete soppraissals. The 
Mmeoue DOCCific area deals with Equipment Cheracteristics of 
Bemerols and displays. Then the Environment of the work 
Station is addressed to assess habitability and restrictions 
to performance. A logical follow-on to that is Job Aid 
adequacy. Safety, Manning requirements, Training assessments, 
and the ability to gather and disseminate Information required 
to complete each task are then addressed. finally, the 
Specific discrepancies noted through the Link Analysis are 
asked. Those questions would hopefuliy be answered before 


Mmmfomiinal sectpon, dust are included as a acuble check. 


toe keoULTS 

There were eight operators interviewed, all with consider- 
able experience, using the questionnaire in appendix ©. The 
aimnowietenis a list of their discrepancy responses with 
respect to the Recovery Assist mission. The numbers in 
parentheses indicate the percentage of operators that answered 
with that response. Responses listed under a Specific section 
were drawn out by reference to that Specific area and would 


Hemempecn otherwise overlooked. 
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I 
(x 


He 


General Question Discrepancies 


= not mentioned in Appendix 4} 


alistis 
1 Ze 


ee 


Difficult communication and tension eontrol coordina- 
tion (75%) 

Inadequate ventilation (75%) 

(*) Port RSD obstructed by deck slope (50%) 

(*) Perspective for centering (62%) 

Sun in eyes when looking on horizon (%07) 
Starboard vision needed (62%) 

Communications bad when A/C in hover/on deck (62%) 
Cable hard to see at night (37%) 

Glare on console panel (75%) 

Invervor sichtbine anadeguate (50%) 

(*) Hook up crew gets tangled in cable ! 50%) 

Need NATOPS holder and grease board (62%) 


Need arseay (1007) 


Bquipment Characteristics 


Te 


Se On) S. 


Windshield wiper controls hard to operate (190%) 
(*) 
(*) Better control/display description (25%) 
(#) 

(*) Need ship speed indicator (25%) 


Preiuectron lock on Tension Control needed (25%) 


Need centering display (50%) 


Environment (all mentioned in General questions). 


Job Aids (all mentioned in General questions). 


Safety 


he 


Need escape door (88%) 
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VI Manning 
ie (*) Two person limit in station (62%) 
VII Training (adequate) 
Peel intormation 
1. Can not see if Main Probe in RSD on landing (884) 
IX Communications (all mentioned in General questicns). 
X Link Analysis Inputs 
1. Perspective problem (62%, yes) 
Pee otarvoara window meeded (62%) 
3. (*) Frame restrictions (100%) 
Meeecomumunication and Tension Control problem (75%) 
5 


Indicator placement change needed (88%) 


heal 





VI. COMPARISONS AND CONCLUSIONS 


The Operator Interviews drew out numerous discrepancies 
ga the General question section alone. This demonstrates 
the advantage of giving representative operators an opportunity 
to critique the system before major construction hegins. 

Once the obvious problems had been revealed, the Specific 
suesvions brought out discrepancies in the realm of unconscicus 
compensation. 

The five Link Analysis inputs contributed even further 
to unconscious compensation. Frame restrictions and rlavce- 
ment of the wind, ship heading, and pitch and roli indicator 
discrepancies were not noted through the use of the Genrral 
Pam opcecl tic questions. 

As assessment of the Task Analysis used in both the Link 
wires and the Functional Mock-up operations was give): 
tentative approval as evidenced by the minimal amount of 
@escrepancies relating to procedures and information avail- 
ability. The need for better A/C centering information and 
main probe position indication on landing were the only 
Hanieom oro blLems. 

Overall, there were 21 discrepancies noted in General 
and Specific questions, plus two additional discrepancies not 
Meogedmoyethe Operator interviews, but detected by link 


aiatysis. Compared to the diserepancies relating to a 


Memeveryessist mission in appendix A, Integration Analysis 
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Beeaciried all of the TECHEVAL discrepancies and most of the 
We@e—-Up Review changes. Items 1, 2, 7, 10, and 12 of the 
Mock-up review were overlooked. But, Integration Analysis 
discovered the 9 additional problems that were noted in the 
Questionnaire Results. The major additions included the need 
meee cenvering display, frame restrictions, and the inability 
tO see the Port RSD due to deck slope. 

When the analysis was conducted for all four missions, 
additional discrepancies were once again noted as compared 
to appendix A, but the same Mock-up review changes were 
solti missed. Major additions include: 

1. Frames obstruct visibility for Deck operations (62%) 

PlOoerndilcationm Of Slow to fast traverse Selection (50% 
nye results to the analyses for the other three missions 
meguired separate task and link analyses and categorization ¢; 
the proper responses in the interviews for the applicable 
Mss lon . 

fiw cONCIUSIONs tO Lhe analysis are biased by the fact 
that the operators had at-sea experience. In addition, many 
of those operators had major inputs into avpendix A, which 
obviously helps to correiate the results. But, their 
meapemses were included in this analysis only if applicable 
to Functional Mock-up capabilities. 

The promising aspect of this proposed technique is that 


teeorodueced additional discrepancies. The analysis is also 


conducted at a relatively low cost compared to an OPEVAL or 





TeCHEVAL. Further, the system has only progressed through 
approximately 40% of the Acquisition Cycle when Integration 
Analysis becomes applicable as compared to about 80% at the 
TECHEVAL/OPEVAL stage. The recent trend of excessive time in 
the later phases of the Acquisition Cycle is mainly due to 
the numerous design changes. Integration Analysis can alleviate 
this problem through its early inseption and expedite the 
whole Acquisition Cycle. 

Integration Analysis also offers a check of equipment 
PimeteseriStics, Environments, safety, training, manning, and 
information acquisition well before Full Development is 
scheduled. Plus, it can be used as an inexpensive, minimun 
time, itterative process that can evaluate major and mincr 
Mra changes to a system. Although not addressed here, iv 
can also be used to check maintenance considerations such as 
accessability, reliability, and repair proceduresi{ Ref. 7}. 

Integration Analysis is actually a formal combination of 
techniques that should be used in every System Acquisition 
T&E process. I[lts early introduction into the process ana 
its inherent use and refinement of critical analysis techniques 
makes it a viable and important step in System Acquisition 


cost reduction and the attainment of optimal designs. 
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APPENDIX A 


LSO CONTROL STATION TECHEVAL DISCREPANCIES 


Complexity of the maneuvering and straightening procedures 
Bue to the multiple switching tasks required by the LS, 
his inability to see the flight deck alignment markings, 
and the lack of visual feedback when maneuvering the 
Gelicopter. 


iMetiae1enG design of the ROD Brake switch on the Ls0 
console, which required that the switch be held in the 
mene or RELEASE position. 


Lack of an indication at the LSO station that the aircraft 
RAST main probe is captured by the RSD arresting beams. 


pemiote Location of the roll indicator in the station 
fobenepereciudes continuous scanning. 


Inappropriate longitudinal and rotational movements of 
ere tRAvtRonm handle on the LSO control console, in 
gee on LO Alrerafy orientation. 


Absence of rearward FOV from the LSO station. 


Gonstant low frequency hum in the LSO headset. 
Ieedequate night fighting of the interior of the LSO 
station. 


Undesirable crosstalk between the LSO UHF and 1JG communi- 
Efemons Circuits during simultaneous transmissions. 


mogeme> Of OTrOVisions for stowage of manuals and operavor 
eeceklists in the LSO station, 


idtepeetcy Ot the LOO and flight deck crewman to see the 
ileecciger cable and end fitting at nignt. 


Pnability of the L50 to communicate on the radio cr 
sound-powered phone circuits during maneuvering and 
Seermencchine due to the requirement to use both hands 
to operate other controls. 


S| 
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RECOMMENDED MOCK-UP REVIEW CHANGES 
Medici t1on ohe LoO console 4" fo the right and lower its 
height 3" so it can be recessed forward. 


Relocate all communication systems from the aft bulkhead 
to the forward and port bulkheads. 


imszatl a t2™ % 32" window in the rear bulkhead. 


Group all window washer/wiper/heater controls on the 
starboard bulkhead above the entrance ladder. 


Install Grimes lights above the LSO console and in each 
corner of the rear bulkhead. 


Install a storage compartment for NATOPS/procedure note- 
books and a folddown seat on the rear bulkhead. 


Install a writing surface (plexiglass with white back- 
ground) above the LSO console. 


Reverse the pitch and roll indicators. 


Relocate the wind direction/velocity indicator to the 
Merwarad port corner of the LsO station. 


Reposition the crash alarm from the port bulkhead to the 
forward port corner of the LSO station above the wina 
direction/velocity indicator. 


Tint the upper and aft (when incorporated) control station 
windows. 


Incorporate an operator-adjustable volume control on the 
1MC loudspeaker. 


Incorporate noise-cancelling microphones in the control 
station and eliminate the UHF/ICS crosstalk. 


Install an emergency escape exit. 
ictattes dual action s(UHP/iiG footswitch. 


Increase the ventilation capacity in the control station. 
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APPENDIX © 
VG 





TASKED. 1 —3.3 

Communications Checks- RA Cable Deployment 
EVC= External Visual Check on Deck 

- - -= Visual Link 

———= Manual Link 


ES = Continuous Action 
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NO WINDOW 


Clear Aircrart For Landing 

EVC= External Visual] Check on Deck; IVC= Internal Visual Check 
EEVC= External Visual Check, Elevated 

- ~ -= Visual Link 

-~----* Manual Link 
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TASK 2305 

Hook Up RA Cable 

EVC= External Visual Check on Deck 
EEVC= External Visual Check, Elevated 
- - -—= Visual Link 

= Manual Link 
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TASK: 3.6 

Establish RA Cable Hover Tension 
EEVC= External Visual Check, Elevated 
IVC= Internal Visual Check 

6.1/6.7= Continuous Action 

- - -= Visual Link 





= Manual Link 
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TASK: | 3505 

Emergency Release ofRA Cable 

EVC= External Visual Check on Deck 
EEVC= External Visual Check, Elevated 
- - -= Visual Link 


= Manual Link 
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TASK? 37 


Direct Landing 

EVC= Extermal Visual Check on Deck 
EEVC= External Visual Check, Elevated 
IVC= Internal Visual Check 

¥o2/7.3= Continuous Action 

- - -= Visual Link 

—_——= Manual Link 
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TASK? °3..7E 

Emergency Wave-Off 
EVC= External Visual Check on Deck 
EEVC= Extermal Visual Check, Elevated 
IVC= Internal Visual Check 

- - -= Visual Link 

Manual Link 
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TASK? 370 

secure Helo in RSD 

EVC= Extermal Visual Check on Deck 
- - -= Visual Link 





= Manual Link 





APE EN DED 


RAST System's LSO Control Station Questionnaire 
fiverviewer —- Ll. Davia Carlson 


PURPOSE 
This questionnaire is designed to accompany interviews that 
tee atyempy to elicit the Opinions of experienced operators 
concerning the Human Factors Hngineering design of the LSO 
Control Station. The data and comments resulting from the 
interviews will be used to help reveal problem areas associated 
With the stations present design. 
Ht Operator Information 
1. Name - 
Bs Height - 
5 Date last operated RAST - 
4. Present date - 
> How many times have you operated the RAST system diring: 
a) Clear weather, day 
i) Traversing = 
Mat) aust ecinane (ners — 
b) Rain, day 
ria) Traversing = 
ii) Flight Ops = 


ec) Clear weather, night 


i) Traversing 


nee?) Flight Ops 


d) Rain, night 


i) Traversing 


| 


cp een Ope = 
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Mic cie rose oueotlons: Ask ecacheguestion in relation to al 
4 missions; Traversing, Launch, Recovery, and Mansuveriag 
and Straightening. 


ile 


Can you recall any problems (no matter how smal 
yOlmexperzenced during your operation of the RA 
If so, what? What do you think was responsible 
What action did you take? 


Comments: 


ve 
¢. 


Did you Ocscmmc emiyone clse having problems? If sc, 
what? What did that person do to relieve the problem? 


Conmen cs. 


Dida the Lesteoperation was a whole, or your job @itmime, 
the test, take much-longer than you had expected it 

to take? Do you know why? Did this extra time afrect 
Velen Det botgiemec: dM an vy wa vy. 


Conmmen tc: 


Can you think of any changes in equipment or procedures 
that must be made to accomplish the mission? 


Comments: 
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ie 


Could you operate the equipment in accordance with 
the procedures you had been taught? If not, cid you 
add any steps? Delete any steps? Perform one or 
more steps differently? 


Comments: 


Assume that someone less skilled than you had to do 


your job. Would there be anything about the equipment, 


procedures, or the mission as a whole that would cause 
a less skilled man difficulties? 


Comments: 


Were there any characteristics of the mission, such 

as equipment, procedures, technical manuals, ete., 

thagemade iuadtttTicult to complete your tasks? Yow 
ZL 


= rm) 


do you know that you had more than your usual diffiecul 


Comments : 


Did the equipment fail in any way to oerform as it 
was supposed to do (in any respect, no matter how 
small)? If so, do you know why? What did you do in 
if ane ON ¢ 


Comments: 
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yt 





oe 


Is every part of the equipment necessary? 


Comments: 


Mc OUmC we teeemeceuamy Gditfreulty as a consequence of 
Cerio omerOr a prolonged period of time? 


Comments: 


Hii Equipment Characteristics: Ask each question in relation 


EO. ad | 


4 missions; Traversing, Launch, Recovery, Maneuvering 


Heide obra envening. 


le, 


Were the controls difficult to operate? Any particular 
controls? Do you know why the controls are difficult 
to operate? How does the difficulty show itself 
(mushiness, illogical movement)? What was the effect 
OmPthe wafficulty on your performance? 


Comments: 


Weme any @©f the controls difficult to reach? How 
important are these controls? What effect does this 
difficulty have on your performance? 


Comments: 


ie 





e 


3. Were any of the displays (meters, indicators) dif: 
to read? How important are these displays? Why wes: 
taiewmemhricultaco read; What was the effect on aur 
performance? 


j-} 
seat 


Comments: 


4. tid the displays provide all the information needed 
tO GO the job? What information was missing? Was 
there too much information? 


Gommen ts 


5. Were any of the displays difficult to understand? 
Wao preciselyrabous the displays was difficult to 
understand? 


Comments: 


lace ou Have any difficulty reading the lettering 
Sel negteaver slighiteoewnenetaey, were unlit? Lit? 


Gomments: 


ve 





(eed anyveGmerncucomtrols jor displays seem unnecessary 
Vemwem@uonn tne poo. Are Cpmem CONnLrols or displays 
Meee ad, 


Comments: 


IV Environment: Ask for each mission. 
i Veco teteie et he Stablon Inadequate at any time 
joi CUOMO euaLen Vi Liumaximum cifiiecrency? Too little 
lighting? Too much lighting (Glare)? 


Comments: 


«. Was the station excessively noisy, improperly venti-ated, 
GOcmcoOOl, SOmmrco warm: How did this affect your 
performance? 


Comments: 


V Joo Aids: Ask for cach mission. 

1. Are the manuals, checklists, and aid equipment you 
need for proper performance available? Are there 
any aids you might need that are not available to 
you « 


Comments: 
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VI 


Safety: Ask for each mission. 


le 


Is there any safety equipment you need that has not 
been provided? 


Comments: 


Are there any desirable safety features that have not 
been included in the design of the station? What are 
these features? dow important are they? 


Commenes: 


Are there any safety hazards in the station that you 
Cotecd: “mse wiat. is all safety information 
conspicuously posted? 


Comments: 


Are all required safety equipment available and 
g@ecessible in the station? if not, what? 


Gomments: 


(aS: 





Vil Mannimge Ask for each mission. 

1. Could you have used more men to do the job than were 
assigned to your team? If so, how many and of what 
Cypemeand what skill level should they have been? 
Could you have used fewer men to do the job? If so, 
which ones would you eliminate? 


Comments: 


2. Was anyone on your team overloaded? Why? 


Comments: 


Pitieirainins: Ask for cach mission. 
Tom Clr rceimmU@nateLNe Uralnins OU were —eiven fOr this 
job was appropriate? What do you recommend to improve 
creinin. « 


Comments: 


2s, Are w@ae men in your team properly qualified in terms 
Crmorenen | hc 2 


Comments: 
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What items were missing from the training you received 
that should be added? Did you receive enough training 
te%do the job? 


Comments: 


What parts of the training were most important for 
safe, efficient operation? 


Comments: 


foo intormation: Ask for each mission. 


ie 


Do you feel that the procedures for operating the 
equipment are completely adequate? Does it reflect 
what you have to do? Does it cover all contingencies? 


Comments: 


Is it difficult to obtain information at any time to 
complete a task? If so, what information? Why? 


Comments: 


(el) 











6 CoOmmiuimi Catil Once Actes, fOrmeach mission. 


ies 


Diem Oumaiave any diificulty in receiving or supplying 
PiPvormatromsLO,Obner personnel over [CS? UHF? If 
SoeeiomsedOwecan these be changed? 


Comments: 


Did the necessity to communicate interfere in any 
way with your job of operating the equipment? 


Comments: 


AI Link Analysis Inputs 


iles 


Did you encounter a perspective problem while trying 
to place the A/C over the RSD? If so, in what direc- 
Moms eedowecdid you correct for it? 


Comments: 


Diem ourrce! that the lack of a starboard window 
degraded your performance? If so, how? 


Commente: 
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<~ 
e 


AY 


Did you encounter difficulties in visual obstructions 
Shem OmeneouGtaulom s Sstrucwuce-: If so, how?’ In what 
dgzeer ens ¢ 


Comments: 


Did sumultaneous tension control and communication 
tasks degrade your performance? If so, how? dow 
did you compensate? 


Comments: 


Pecmune Wimcdmopeed, Velocity, prtich and roll, and 
ship heading indicators adequately located? If not, 
how should they be positioned? 


Gomments: 


(s 





on 
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